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£SJ , This paper is concerned with general analysis on the rank and row-redundancy of an array of circulants whose 

null space defines a QC-LDPC code. Based on the Fourier transform and the properties of conjugacy classes and 
Hadamard products of matrices, we derive tight upper bounds on rank and row-redundancy for general array of 
circulants, which make it possible to consider row-redundancy in constructions of QC-LDPC codes to achieve better 
performance. We further investigate the rank of two types of construction of QC-LDPC codes: constructions based on 
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Vandermonde Matrices and Latin Squares and give combinatorial expression of the exact rank in some specific cases, 

a ■ 

which demonstrates the tightness of the bound we derive. Moreover, several types of new construction of QC-LDPC 
codes with large row-redundancy are presented and analyzed. 



I. Introduction 

Quasi-cyclic (QC) codes have been a challenging and ongoing research subject in algebraic coding theory since 
their introduction in late 1960's [1]. These codes asymptotically achieve the Varshamov-Gilbert bound [2]. Recent 
research of these codes has been focused on a subclass of these codes, known as QC low-density parity-check 
(LDPC) codes. 

LDPC codes were first discovered by Gallager in 1962 [3] and then rediscovered in late 1990's [4], [5]. Ever 
since their rediscovery, a great deal of research effort has been expended in design, construction, structural and 
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performance analysis, encoding, decoding, generalizations, and applications of LDPC codes. They have been shown 
to achieve the Shannon capacities for a wide range of channels with iterative decoding based on belief propagation. 

Major methods for constructing LDPC codes can be divided into two general categories, graph-theoretic based and 
algebraic methods. Each type of constructions has its advantages and disadvantages in terms of overall performance, 
encoding and decoding implementations. In general, algebraically constructed LDPC codes have lower error-floors 
and their decoding using iterative message-passing algorithms, such as the sum-product algorithm (SPA) and 
the min-sum algorithm (MSA) converge faster than the LDPC codes of the length and rates constructed using 
the graph-theoretic -based methods. Furthermore, it is much easier to construct algebraic LDPC codes with large 
minimum distances. Algebraic constructions of LDPC codes are mainly based on finite fields, finite geometries, 
and combinatorial designs. These constructions result in mostly QC-LDPC codes. 

QC-LDPC codes have advantages over other types of LDPC codes in hardware implementation of encoding and 
decoding. Encoding of a QC-LDPC code can be efficiently implemented using simple shift registers with complexity 
linearly proportional to its number of parity-check symbols (or its length) [6]. In hardware implementation of its 
decoder, the quasi-cyclic structure of the code (or circular structure of its parity-check matrix) simplifies the wire 
routing for message passing [7] and allows partially parallel decoding [8] which offers a tradeoff between decoding 
complexity and decoding speed. Furthermore, well designed or constructed QC-LDPC code can perform as well as 
any other types of LDPC codes. Most of LDPC codes adopted as standard codes for various next generations of 
communication systems are QC-LDPC codes. 

A g-ary QC-LDPC code is given by the null space of an array H of sparse circulant matrices (or simply circulants) 
of the same size over the field G¥(q) where q is a power of prime. If the array H, viewed as a matrix, has constant 
column weight 7 and constant row weight p, the code given by the null space of H is said to be (7,p)-regular, 
otherwise it is said to be irregular. 

In almost all of the proposed constructions of LDPC codes, the following constraint on the rows and columns 
of the parity-check matrix H is imposed: no two rows (or two columns) can have more than one place where 
they both have identical non-zero components. This constraint on the rows and columns of H is referred to as the 
row-column (RC)-constraint. This RC-constraint ensures that the Tanner graph [9] of the LDPC code given by the 
null space of H has a girth of at least 6 and that the minimum distance of the code, if (7,p)-regular, is at least 7 + 1 
[10], [11]. The distance bound is tight for regular LDPC codes whose parity-check matrices have large column 
weights and row redundancies, such as the algebraic LDPC codes constructed using finite fields, finite geometries 
and combinatorial designs. A parity-check matrix H that satisfies the RC-constraint is called an RC-constrained 
parity-check matrix and the code given by its null space is called an RC-constrained LDPC code. 

The overall performance of an LDPC code with iterative decoding based on belief propagation is measured by: 
(1) its bit and block error performance (i.e., how close it performs to the Shannon limit or sphere packing bound); 2) 
the rate of decoding convergence (i.e., how fast the decoding converges to a valid codeword); (3) its error-floor; and 
(4) how efficient it can be encoded and decoded. Extensive studies and simulation results show that the performance 
of an LDPC code is determined by a number of structural properties of the code collectively: (1) minimum distance 
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(or minimum weight); (2) girth and cycle distribution of its Tanner graph; (3) degree distributions of variable- and 
check-nodes of its Tanner graph; (4) trapping set distribution of its Tanner graph; (5) row redundancy of its parity- 
check matrix; and (6) other unknown structures. No single structural property dominates the performance of a code. 
It is still unknown how the code performance depends on the above structural properties analytically as a function. 
However, some general information is known how to design (or construct) LDPC codes that perform well. Recently, 
it was proved that for an RC-constrained (7,p)-regular LDPC code, its Tanner graph contains no trapping set of 
size k < 7 with the number of odd degree check-nodes smaller than 7 [12]. Several classes of algebraic LDPC 
codes were proved that they do not contain harmful trapping sets of sizes smaller than their minimum distances. 
Consequently, the error-floors of these codes are primarily dominated by their minimum distances. 

For a code with a given rate to perform close to the Shannon capacity (or its threshold) in the waterfall region, 
the degree distributions of the variable- and check-nodes of its Tanner graph must be properly designed (say, based 
on density evolution [13]). For a code to have low error-floor, it must have a relatively large minimum distance and 
no harmful trapping sets with sizes smaller than its minimum distance. In this case, the error-floor is dominated 
by its minimum distance. Furthermore, the error-floor performance of a code also depends on the girth of the 
code's Tanner graph. In general, a girth of 6 is enough if the code has large minimum distance and no small 
trapping sets. For the decoding of a code to converge fast, besides requiring no harmful small trapping sets and 
relatively large minimum distance, large row redundancy (large number of dependent rows) of its parity-check 
matrix helps. Extensive simulation results show that the decoding of a code converges very fast, if its parity-check 
matrix has a large row redundancy. Cyclic and QC-LDPC codes constructed using finite fields, finite geometries 
and combinatorial designs do have large row redundancies in their parity-check matrices. Iterative decoding of 
these codes does converge very fast. For efficient encoding and decoding hardware implementation of an LDPC 
code, quasi-cyclic or cyclic structure is desirable. How to design or construct an LDPC code with the above good 
structures is an unsolved but challenging problem. 

In general, QC-LDPC codes (regular or irregular) given by the null spaces of arrays of circulants constructed 
algebraically based on finite fields, finite geometries and combinatorial designs [10], [12], [14] -[24] do have a good 
balance in terms of minimum distance, trapping set structure, row redundancy, and girth. Masking the parity-check 
array of a QC-LDPC code based on well designed degree distributions of the code's Tanner graph also provides 
good error performance in the waterfall region as shown in [20]. 

Recent development in QC-LDPC codes (QC codes in general) is the introduction of a matrix-theoretic approach 
for studying these code based on matrix transformation via Fourier transforms [25], [26]. This approach is amicable 
to the analysis and construction of QC-LDPC codes. In Fourier transform domain, the parity-check matrix of a 
QC-LDPC code, as an array of circulants, is specified by a set of base matrices (or a single base matrix) over a finite 
field that satisfies certain constraints. Based on these base matrices, an RC-constrained array of sparse circulants 
can be easily constructed. The null space of this RC-constrained array then gives an RC-constrained QC-LDPC 
code whose Tanner graph has a girth of at least 6. From these base matrices, it is quite easy to analyze the rank 
of the parity-check array of the code and to derive the necessary and sufficient condition for the code's Tanner 
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graph to have a given girth. The Fourier transform approach put all the algebraic constructions of QC-LDPC codes 
developed in [17], [20], [21]-[24], [25] under a single framework. 

Although many types of algebraic constructions of QC-LDPC codes have been proposed and some rank expres- 
sions have been given [17], [20], [21]-[24], [25], there is still a lack of general algorithms and guideline to construct 
QC-LDPC codes with large redundancy, and the existing rank analysis and expressions are only applicable to some 
specific cases. 

In this paper, we follow the Fourier transform approach presented in [25] to expand the analysis and construction 
of new QC-LDPC codes. Analysis includes the rank and row redundancy of an array of circulants whose null space 
gives a QC-LDPC code. A recursive algorithm for computing the rank or the row redundancy of a parity-check 
array in terms of its base matrices in Fourier transform domain is developed. Tight upper and lower bounds on the 
rank and row redundancy of an array of circulants are derived . In special cases, combinatorial expressions for the 
exact ranks are obtained. New constructions of algebraic QC-LDPC codes in the Fourier transform domain with 
large redundancy are given, and the simulation result demonstrate that the constructed QC-LDPC codes outperform 
the corresponding random LDPC codes . Ranks and row redundancies of the parity-check arrays of some known 
QC-LDPC codes are further investigated. 

The organization of the rest of this paper is as following: First, we present the characterization of QC codes, 
binary QC-LDPC codes and nonbinary QC-LDPC codes in the Fourier transform domain in Section II, Section 
III and Section IV, respectively. Then, we analyze ranks and row redundancies of QC-LDPC codes in terms of 
transform domain in Section V. A tight upper bound on ranks and a tight lower bound on row redundancies are given 
in this section. Later, we explain the reason why row redundancies can increase the performance of message-passing 
algorithms. In Section VI, we further analyze the rank for two types of well-known LDPC codes constructed based 
on Vandermonde Matrices and Latin Squares and show that the bound derived in Section V we construct a class 
of RC-constrained QC-LDPC codes based on random partitions of finite fields. In Section VII, we propose several 
types of constructions of QC-LDPC codes with large row redundancies which outperform random LDPC codes. 
The paper is summarized in the last section. 

II. Characterization of QC Codes in the Fourier Transform Domain 

In this paper, we consider only QC-LDPC codes constructed from finite fields of characteristic of 2. In this and 
next sections, we give a review of characterization of QC codes in Fourier transform domain presented in [25]. 
Some new interpretations and extensions are given. 

A. Matrix Transformation 

Let GF(2 r ) be a finite field with 2 r elements which is an extension field of the binary field GF(2). Let a be a 
primitive element of GF(2 r ). Then, the powers of a, a~°°,ot = 1, a, a 2 , . . . , a 2 ' "~ 2 , give all the elements of 
GF(2 r ) and a 2 ^ 1 = 1. 
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Let q = 2 r and e = 2 r — 1. Let a = (ao, Oi, a e -i) be an e-tuple (or vector) over GF(2). Its Fourier transform 
[25], [27] denoted by T[a], is given by the e-tuple b = (bo, &i, & e -i) over GF(g) whose t-th component, 6 t , for 
< t < e, is given by 

6 t = a + a X 0L l + a 2 a 2t + ■■■ + a e _ia (e_1)t . (1) 

The vector a, which is called the inverse Fourier transform of the vector b, denoted by a = J r_1 [b], can be 
retrieved using the following equation: 

ai = b + ha' 1 + b 2 a- 21 + ■■■ + b^a-^ 1 (2) 

for < I < e. 

An e x e matrix of over a field is called a circulant if every row is a cyclic-shift (one place to right) of the row 
above it and the first row is the cyclic-shift of the last row. A circulant is uniquely specified by its top row which 
is called the generator of the circulant. 

Let A = [dij], < i, j < e, be an e x e circulant over GF(2). Then, we write A = circ(ao,ai, ...,a e -i), where 
(ao, ai, a e _i) is the generator of A. Define two ex e matrices over GF(q) as follows: V = < i, j < e 

and V -1 = [a*- 7 '], < i,j < e. Both matrices, V and V -1 , are known as Vandermonde matrices [27], [28] and 
they are non-singular. Furthermore VV _1 = I, where I is an e x e identity matrix. Hence, V^ 1 is the inverse of 
V and vice versa. Taking the matrix product VAV -1 , we obtain the following ex e diagonal matrix over GF(2 r ), 

A^ = VAV- 1 = diag(bo, h, 6 e _i). (3) 

where the diagonal vector (bo,b\,..., 6 e _i) is the Fourier transform of the generator (ao, Oi, a e -i) of the circulant 
of A. The diagonal matrix A^ = VAV -1 is referred to as the Fourier transform of the circulant A. In the rest of 
the paper, we only consider circulants over GF(q) of size ex e with q = 2 r and e = 2 r — 1. 

Since (ao,ai, ...,a e _i) is an e-tuple over GF(2), the components must satisfy the following constraint [25]: 

6(2t)« = b 2 t (4) 

for < t < e, where (2t) e denotes the nonnegative integer less than e and congruent to 2t modulo e. This condition 
is known as the conjugacy constraint. Conversely, if an e-tuple (bo,b\,..., & e -i) over GF(q) satisfies the conjugacy 
constraint, its inverse Fourier transform gives an e-tuple (ao, Oi, a e _i) over GF(2). 

Let m and n be two positive integers. Let H = [A^-] < i < m, < j < n be an m x n array of e x e circulants 
Aij over GF(2). For < i < m, < j < n, let (a^o, ■■■,ai,j,e-i) be the generator of the circulant A it j. 
Next, we define two diagonal arrays of e x e Vandermonde matrices V and V -1 as follows: 

fi(m) = diag( y,V V) , (5) 

m 
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(6) 



where Q(m) is an m x m diagonal array of the Vandermode matrices V's and ft 1 (n) is an n x n diagonal array 
of Vandermonde matrices V _1 's. Then the Fourier transform of H is given as follows: 



H- 77 = nfroJHfi- 1 ^) 

A 77 A 77 

A- 77 A 77 

■"■1,0 -"-1,1 



A- 7 " 

•"■l.n-l 



(7) 



where = VA^-V -1 , < i < m, < j < n, is an e x e diagonal matrix over GF(2 r ) with diagonal vector 
{bi,j,0:h,j,i: ■■■■> bi,j,e-i) which is the Fourier transform of the generator (a^o, o»,j,i, Oj^e-i) of A^-. 

The array H 77 is an me x ne matrix over GF(q). Label the rows and columns of H 77 from to me — 1 and 
to ne — 1, respectively. Define the following index sequences: for < i, j < e, 



and 



Let 



and 



itrow.i = [i,e + i, (m - l)e + i], 



Kcoij = [j, e + j, (n - l)e + j]. 



T^row — [^*ro-u;,0 j ^row,l ; • • • ; ^row,2 r — 2] j 



(8) 



(9) 



(10) 



(11) 



Then 7r roM , gives a permutation of the indices (labels) of the rows of H 77 and n co i gives a permutation of the indices 
of columns of H 77 . 

Suppose we first permute the rows of H 77 based on Tr row and then the columns based on 7r co ;. These row and 
column permutations result in the following e x e diagonal array of m x n matrices over GF(q), 

= dioff(B ,Bi,...,B 2 r_ 2 ) 

B O O ... O 
O Bi O ... O 



OOO 



B91 



2 r -2 



(12) 



where tt = (n row ,n co i) denotes the combination of the row and column permutations, n row and n co i. The m x n 
matrices B/s on the diagonal of the array H F,7r satisfy the conjugacy constraint. To specify this constraint, we 
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introduce the concept of Hadamard product. 

Let B = [bij] and C = [aj] be two matrices of the same size. The Hadamard product of B and C [29], denoted 
by B o C, is defined as their element-wise product, i.e., B o C = [bijCij]. The Hadamard product of t copies of 
the matrix B, where t is a nonnegative integer, denoted by B ot , is B ot = \b\^\ which is referred to as the t-th 
Hadamard power of B. We allow t to equal and in this case 6? • = 1 if bij is a nonzero element in GF(2 r ) and 
bl 3 = if //,., = 0. 

For an array H of circulants and zero matrices over GF(2), the matrices on the main diagonal of the array H JF ' 7r 
satisfy the conjugacy constraint [25], 

B (2t) e = B t° 2 ; (13) 

i.e., the entry at the location of B( 2 t) c is the square of the entry at the location of B t . We call the 

matrix B( 2 t) e a conjugate matrix of B t . 

Conversely, if the matrices on a diagonal array of the form given by (12) satisfy the conjugacy constraint given 
by (13), then the array obtained by taking inverse row and column permutations and inverse Fourier transform, we 
obtain an array of circulants over GF(2). 

The transformation from H to H^ ^ through is reversible. Given an e x e diagonal array H = H^'^ = 
diag(Bo, Bi, B e _i) of to x n matrices over GF(q), one can perform inverse permutation n^ 1 = {tt~^ w , tt~ o1 ) on 
the rows and columns of H to obtain an to x n array H" of e x e diagonal matrices Afj . Next, perform inverse 
Fourier transform on EP , i.e., replacing each diagonal matrix Afj in EP by an e x e circulant whose first 
row is the inverse Fourier transform of the diagonal vector of the diagonal matrix Af^. This results in an to x n 
array H" 1 >- F = H of e x e circulants over GF(2). Thus, we have a one-to-one correspondence between an array 
of circulants over GF(2) and a diagonal array of matrices over GF(q). 

The transformation from H to H- 7 ^ 71 " preserves the rank of the matrices. Let rank(M.) denote the rank of a 
matrix M over a finite field. Since H- 7r,7r = diag(Bo, Bi, B e _i), then 

rank(H) = ranfc(Bo) + rank(B) + rank(B 2 ) + • • • + ranker e _\\), (14) 

In a latter section, we develop a recursive algorithm for computing the rank of H, rank(H), based on the conjugacy 
constraint on matrices, B , Bi, B e _i, given by (13). 

B. Characterization of Binary QC Codes in Fourier Transform Domain 

Consider a binary QC code C qc given by the null space of an m x n array H = [A^j] 0<i<m, 0<j<n 
of e x e circulant matrices Aij over GF(2). H is an me x ne matrix over GF(2). The one-to-one correspondence 
between arrays H = [Aij] of circulant matrices and diagonal arrays H- 7 ^ 71 " = diag(Bo,Hi, ...,B e _i) of matrices 
and the conjugacy constraint on the matrices Bo, Bi, B e _i on the diagonal of H- 7 ^ give the basis for studying 
QC codes in Fourier transform domain. 

Partition the set £ = {0, 1, e— 1} of integers into cyclotomic cosets of 2 modulo e [25], [30] where e = 2 r — 1. 
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Let t be an integer in £. The cyclotomic coset containing t is 

Z t = {t,(2t) e ,(2 2 t) e ,...,(2 c '- 1 t) e }, (15) 

where c t is the smallest positive integer satisfying 2 Ct t = t mod e. Each coset has a smallest member which 
we call the coset representative. The conjugacy constraint given by (4) constrains the components of the Fourier 
transform of a binary vector whose indices are in the same cyclotomic coset. All these components are powers of 
the component whose index is the coset representative. 

It follows from the conjugacy constraint on the matrices B ,Bi, ...,B e i in the diagonal array H- F ' r given by 
(13) that all matrices B t whose indices are in the same cyclotomic coset are determined by the matrix whose index 
is the coset representative. The matrices with indices in the same cyclotomic coset modulo e are conjugate matrices 
which form a conjugate class. Given one matrix in a conjugate class, we can determine all the other conjugate 
matrices in the same class. Consequently, the binary parity-check array H is determined by the matrices B t 's for 
which the t's are coset representatives of all the distinct cyclotomic cosets. In particular, H is specified by a number 
of matrices B t equal to the number of cyclotomic cosets of 2 modulo e. Therefore, the construction of an to x n 
array of e x e circulants over GF(2) consists of the following steps: 

1) Determine the cyclotomic cosets of 2 modulo e. Let Z , Zi, Za-i be all the cyclotomic cosets modulo 
of 2 modulo e, where Zo = {0} and A is the number of cyclotomic cosets. Let to = 0,ti, ...,t\-i the coset 
representatives of Z , Zi, Za-i- 

2) Choose A to x n matrices B to ,B tl , ...,B tA1 over GF(<j) with q = 2 r . 

3) For each B ti , < i < A, we form all its conjugate matrices. This gives e matrices B , Bi, B e „i of size 
to x n. 

4) Form the e x e diagonal array H- 7 ^ = diag(B , Bi, B e _i). 

5) Performing inverse permutations 7r~ ^, and ir^ on the rows and columns of the array H- 7 ^ 71 " (as an me x me 
matrix over GF(q)), we obtain an m x n array of e x e diagonal matrices over GF(q). 

6) Performing the inverse Fourier transform J 7-1 on the array H-^, we obtain an array to x n array of circulant 
over GF(2). 

The null space of H gives a QC code C qc . Therefore, the construction of a binary QC code is determined by the 
choice of the base matrices B to ,B tl , ...,B tA _ 1 . 

If H is an array of sparse circulants over GF(2), then the null space of H gives a QC-LDPC code C qc . As an 
me x ne matrix, if H satisfies the RC-constraint, then the Tanner graph of the QC-LDPC code C qc given by the 
null space of H has a girth at least 6. If H is a regular matrix with column weight 7, then the minimum distance 
of C qc is at least 7 + 1. 
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III. Characterization of a Class of Binary RC-Constrained QC-LDPC Codes in Fourier 

Transform Domain 

Typically, in most constructions of parity-check matrices of QC-LDPC codes, each circulant is either a zero 
matrix (ZM) or a circulant permutation matrix (CPM), i.e., a circulant with exactly one non-zero entry in each row 
and each column and this entry is 1. 

If H is an m x n array of CPMs and/or zero matrices (ZMs) of size e x e, the conjugacy constraint of (13) 
becomes the following constraint [25]: 

B t = Bf (16) 

for < t < e, i.e., B t is the t-th Hadamard power of Bi. In this case, the array given by (12) is uniquely 

specified by the matrix Bi. As a result, we could remove the subscript "1" from Bi and use B for Bi. Then, the 
array H? r ' 7r has the following form [25]: 

= dm 9 (B o0 ,B ol ,...,B°( 2r - 2 )) 
B° O O ... O 

O B o1 O ... O (17) 

O O O ... B ' 2 " - 2 ) 

The result given by (17) actually says that, in the Fourier transform domain, any array H of CPMs and/or ZMs is 
completely specified by a matrix B over GF(q) with q = 2 r . Any m x n matrix over GF(q) can be used as the B 
matrix. 

To contract a QC-LDPC code, we begin with an appropriately chosen m x n matrix B over a finite field 
GF(g). Form an e x e diagonal array H = diag(B o0 ,B ol ,...,B o( - 2r - 2 y) of the form (17). Next, we apply the 
permutation n^ 1 = (^rowT n coi) on tne rows an d columns of H to obtain an m x n array LP = [Af^] of 
diagonal matrices Afj of size of e x e. Then, we take the inverse Fourier transform of H 1 1 to obtain an m x n 
array H*" = H = [Ajj] < i < m, < j < n of CPMs and/or ZMs of size e x e. H is an me x ne matrix 

over GF(2). For r > 3, H is a low-density matrix. The null space of H gives a QC-LDPC code C qc . Since the 
array H is constructed from B, we call B the base matrix for code construction. 

If the base matrix B satisfies the condition given by the following theorem, then the parity-check matrix H of 
the QC-LDPC code C qc satisfies the RC-constraint and its Tanner graph has a girth at least 6. We will state the 
theorem without a proof. A proof can be found in [25]. 

Theorem 1. A necessary and sufficient condition for an array H of CPMs and/or ZMs to satisfy the RC-constraint 
is that every 2x2 submatrix in the base matrix B contains at least one zero entry or is non-singular. 

The necessary and sufficient condition on a base matrix given in Theorem 1 is called the 2x2 submatrix 
(SM)-constraint. A base matrix B that satisfies the 2 x 2 SM-constraint is called a 2 x 2 SM-constrained base 
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matrix. 

Next, we show that construction of an RC-constrained LDPC matrix of a QC-LDPC code which consists of an 
array of CPMs and/or ZMs can be carried out directly from a 2 x 2 SM-constrained base matrix B without forming 
the array H = diag(B°°, B o1 , B°' e_1 '), taking the inverse row and column permutations and the inverse Fourier 
transform. 

Consider an e x e CPM A = circ(a , Oi, a e -i) over GF(2) with generator (a , a\, a e -i) which contains 
a single 1-component. Suppose the single 1-component of (a ,ai, ...,a e _i) is at the fcth position, i.e., a\- = 1 and 
a t = for t ^ k. It follows from (1) and (2) that the diagonal vector (bo,bi, •■• ) &2 r -2) of the Fourier transform 
A T of A is 

(b ,h,...,b 2 r_ 2 ) = (a°,a k ,a 2k ,...,a^ k ), (18) 

which consists of e consecutive powers of a k . Conversely, if a diagonal matrix over GF(q) with diagonal vector 
(a , a k , a 2k , a^ e ~^ k ), then its inverse Fourier transform is an e x e CPM whose generator has its single 1- 
component at the position k. 

Let B = [hj}, < i < m, < j < n, be the chosen base matrix for code construction. Construct the diagonal 
array = diag(B°°, B o1 , B°' e_1 ') given by (17), where B°* = [bjj, < i < m, < j < n, for 

< t < e. Applying the permutation tt^ 1 — (tt~J- w , 7t~j) on the rows and columns of H -7 ^ 71 ", we obtain the array 
= of diagonal matrices Afj . For < i < m, < j < n, we find that the diagonal vector of Afj 

is (l,bij,b 2 j, ...,6?J ). If bij — a k , then Aij, the inverse Fourier transform of Afp is an e x e CPM whose 
generator (ao,cti, ...,a e _i) has its single 1-component at the position k. 

Based on the above analysis, construction of an RC-constrained low-density parity-check array H of CPMs and/or 
ZMs can be constructed directly from a chosen base matrix B = [bij], < i < m, < j < n which is 2 x 2 
SM-constrained. This is carried out as follows: (1) if bij is an nonzero element in GF(2 r ) and bij = a k with 
0<k<e = 2 r — 1, then we replace bij by an e x e CPM whose generator has its single 1-component at position 
k; and (2) if bij — 0, then we replace bij by an e x e ZM. This gives the RC-constrained array H of CPMs and/or 
ZMs corresponding to the chosen base matrix B that satisfies the 2x2 SM-constraint. Then, the null space of H 
gives an RC-constrained QC-LDPC code whose Tanner graph has a girth at least 6. The above replacement of an 
entry bij in a base matrix B by either an e x e CPM or an e x e ZM is referred to as the e-fold matrix dispersion 
of bij. The array H is called the e-fold array dispersion of B [20]. 

It is clear that the transpose B T of a 2 x 2 SM-constrained base matrix B also satisfies the 2x2 SM-constraint 
and hence it can be used as a base matrix to form an RC-constrained array of CPMs and/or ZMs whose null space 
gives an RC-constrained QC-LDPC code. If H is an RC-constrained array of CPMs and/or ZMs constructed from 
B, then the RC-constrained array constructed from B T is the transpose H T of H. 

The above construction puts all the constructions of QC-LDPC codes based on finite fields given in [17], [19], 
[21]-[24], [25] under a single framework. In these papers, the base matrices are constructed based on finite fields 
and combinatorial designs. 
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Consider an RC-constrained QC-LDPC code C qc given by an to x n array H = [A^j] of e x e CPM's and/or 
ZM's which is specified by a 2 x 2 SM-constrained m x n base matrix B = [hj]. If bij ^ 0, < i < to, 
< j < n, then multiplying it by zero results in replacing the CPM Ajj by a zero matrix. This procedure, known 
as masking, was used in previous work to optimize the column and row weights of the parity-check matrices and 
to reduce the number of short cycles in the Tanner graphs of the constructed codes [20]. This is accomplished 
by judiciously designing an to x n binary matrix Z = [zij], < i < to, < j < n, which we call a masking 
matrix. After masking, we obtain the masked base matrix B masfe = ZoB = [ z i,jbij], whose entry equals 
bij if Zij — 1 and equals zero if Zij — 0. Performing e-fold matrix dispersion of each entry in the masked base 
matrix B mas fc, we obtain a masked array, denoted by H mas fc. The null space of the masked array H mas k gives a 
new RC-constrained QC-LDPC code. Masking is an effective technique for construction both regular and irregular 
QC-LDPC codes [20]. 

IV. Characterization of a Class of Non-Binary RC-Constrained QC-LDPC Codes in the 

Fourier Transform Domain 

In this section, we show that RC-constrained arrays of non-binary CPMs of a special type can also be constructed 
using the base matrices constructed in Section II. The null spaces of these arrays give a class of non-binary QC- 
LDPC codes. 

Again we consider code construction based on fields of characteristic of 2. Let a be a primitive element of GF(q) 
with q = 2 r . Again, let e = 2 r — 1. For < fc < e, let P(a k ) be an e x e matrix over GF(<7) with columns and 
rows labeled from to e — 1 which has the following structures: (1) the top row of P(a k ) has a single nonzero 
component with value a k at the fc-th position; and (2) every row of P{a k ) is the cyclic-shift (one place to the 
right) of the row above it multiplied by a and the first row is the cyclic-shift of the last row multiplied by a. 
This e x e matrix P(a k ) over GF(2 r ) is called an a-multiplied CPM [31]. There are e such a-multiplied CPMs. 
For < k < e, we represent the element a k of GF(q) by the a-multiplied CPM P(a k ). This representation is 
one-to-one. P(a k ) is referred to as the a-multiplied CPM dispersion (or simply dispersion) of a k . 

Next, we replace each nonzero entry (a power of a) of a chosen 2x2 SM-constrained to x n base matrix B by 
its corresponding a-multiplied e x e CPM and a zero entry by an e x e ZM. This results in an to x n RC-constrained 
array H Q of a-multiplied CPMs of size ex e over GF(g). It is an me x me matrix over GF(q). Its null space gives 
a q-ary RC-constrained QC-LDPC code whose Tanner graph has a girth of at least 6. 

The array H Q consists of n column blocks of a-multiplied CPMs, denoted Ha',Ha', Hi" X \ Each column 

(i) 

block Ha of a-multiplied CPMs with < j < n is an me x e matrix over GF(q). Due to the structure of an 
a-multiplied CPM, all the nonzero elements in the fc-th column of H„ ' are a k for < k < e and < j < n. We 
call a k the value of the fc-th column of H„'. View the overall array H Q as an me x me matrix over GF(q). If 
we multiply each column of H a by the multiplicative inverse of its value, we obtain the binary array H of CPMs 
constructed from the base matrix B as given in Section III. Therefore, the rank of H Q is the same as that of H, 
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i.e., 

rank(H a ) = rankCH) 

(19) 

= rank(B°°) + ranfc(B) + rank(B° 2 ) H + rank(B o{e ^). 

Masking can also be performed on the base matrix B to construct regular or irregular non-binary QC-LDPC codes 
using a-multiplied CPM dispersion of each nonzero entry in the masked base matrix B mas fc. 

V. Rank and Row Redundancy Analysis 

In this section, we give a general analysis of the rank and row redundancy of the parity-check matrix of a 
QC-LDPC code which is an array of CPMs and/or ZMs in the Fourier Transform domain. The row redundancy 
of a matrix is defined as the ratio of the number of redundant rows (or dependent rows) of the matrix to the total 
number of rows of the matrix. For an algebraic LDPC code, large row redundancy speeds up the rate of decoding 
convergence, i.e., requiring smaller number of iterations for the decoder to converge to codeword than other types 
of LDPC codes. 

A. Rank Analysis 

Consider a binary QC-LDPC code C qc given by the null space an to x rt array H = [A^ j] ,0 < i < to, < j < n, 
of e x e CPM's and/or ZMs which is the array dispersion of an to x n base matrix B over GF(g) where q = 2 r 
and e = 2 r — 1. The rank of H is given by (19). If we can determine the rank of each Hadamard power of the 
base matrix B, then we can determine the rank of the parity-check matrix. 

If H is an array of circulants and ZMs over GF(2), based on the conjugacy constraint specified by (13), it can 
be readily proved by induction that for any integers t > 0, 

B (a , t)< = Bf\ (20) 

From (l20l we can group the e matrices Bo,Bi, ...,B e _i into conjugacy classes. Let A be the number of distinct 
conjugacy classes and ^o, Wi, 'J'a-i denote these classes, where contains only the matrix Bo and "fi contains 
Bi and its conjugate matrices. For < i < A, let Cj be the number of matrices in the conjugacy class ^i, where 
c, is the smallest nonnegative integer such that (2 Ci t) e = t. Suppose B ti is member matrix in ^j, then it follows 
from d20]l that 

*« = {Bt^Btf: ■■■'Bjf * } = {B( t .) e ,B( 2tj ) e ,...,B( 2 c j -i ti)e }. 

The subscripts of the conjugate matrices in 'J; actually form the cyclotomic coset = {f,*, 2£j, 2 Ci ~ 1 ti} modulo 
e. It is clear that for i = 0, we have < s ; = and Cj = 1. The matrix in with the smallest power is called the 
representative of the conjugacy class V&i. The following theorem shows that matrices in the same conjugacy class 
have the same rank. 

Theorem 2. Let B be an m, x n matrix over GF(q). For any nonnegative integer t < r, the matrix B° 2 (the 2 f -th 
Hadamard power of Bj has the same rank as B. 
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Proof: Let n be the rank of B. Let , bj 2 , bj be a set of linearly independent rows of B where < 
i\, 12, ifj. < m. Let a^, a,i 2 , a, be any set of elements in GF(q), not all zero. Then 

^a t! b 4i ^ 0. 
1=1 

Raising the above sum vector to the power 2*, since the characteristic of the field GF(g) is 2, we have 

l=i i=i 

= f^Xr'Vo. (2D 
;=i 

The vectors (b^ ) o2 \ (bj 2 ) 02 ' , (bjj 02 ' are // rows in the matrix B o2 \ the 2*-th Hadamard power of B. The 
expression of (20) implies that (b^) 02 , (bj 2 )° 2 , (bj ti )° 2 are linearly independent. This implies that 

rank(B o2t ) > rank(B). (22) 

Notice that (B 02 *) 021 "' = B. Let fj,' be the rank of B° 2 ' and (bjj 02 ', (b l2 ) o2 \ (b^,) 02 ' be the independent 
rows of B° 2 *. In a similar way, we can show that b^ , bj 2 , bj , are linear independent rows of B. This implies 
that 

rank(B) > ranfc(B o2 '). (23) 

The inequalities of d22t and d23l imply that ran fc(B° 2 ) = remfc(B). ■ 
It is clear that for i = 0, we have ti = and Cj = 1. The matrix in ^ with the smallest power is called the 
representative of the conjugate class ^j. For < i < A, let /Ltj be rank of the matrices in the conjugate class \I/j, 
then, it follows from (19) and Theorem 2 that the rank of the parity check matrix H of a QC-LDPC code obtained 
by array dispersion of a base matrix B is given by 

ranfc(H) = + Ci/ii + ... + c re _i/ix_i. (24) 

Note that [iq and /ii are the ranks of Bo = B°° and B = B o1 , respectively. If we know cq, c\, cx-i and 
Ho, l^i, ■••iMA— 1> men we can compute the rank of H from (24). This can be done by first partitioning the set 
{B°°, B, B° 2 , B°( e_1 ^} into A conjugate classes "Jo, 'S'a-i an d determining the rank of the conjugate 

matrices in each class. Then, use (24) to compute the rank of H. This can be carried out systematically. 

As pointed above, the powers of matrices in a conjugate class ^ = {B oti . B o2ti , B° 2 1 4i } form a cyclotomic 
coset Zj = {ti, 2ti, 2 Ci ~ 1 i;} of 2 modulo e. Therefore, to find the conjugate class ^ is equivalent to find the 
powers of the matrices in In the following, we present a recursive construction of the cyclotomic cosets, 
Zo, Zi, Za-i of 2 modulo e. In the construction, the first elememt i, of each cyclotomic coset Zj is always the 
smallest integer, the coset representative. In this case, the matrix B oti is the representative of the conjugate class 
^i. We begin with the cyclotomic class ^/q — {0} which contains only the integer 0. Suppose we have completed 
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the construction of the zth cyclotomic coset (i.e., *o, have been constructed). To construct the ith 

cyclotomic coset 'J'j, we choose the smallest integer t, in the set £ = {0, 1, e — 1} but not in any of cyclotomic 
cosets Zo, Zi, Zj_i. With ti as the first element of the cyclotomic coset Zj, we form Z, = {ij, 2£j, 2 Ci ~ 1 t i ). 
It is clear that tj is the smallest integer in Zj and hence the representative of Zj. Continue the above construction 
process until we form all the cyclotomic cosets of 2 modulo e. It is clear that ti — 1 must be in one of the cyclotomic 
cosets, Zo, Zi, Z^ 

In the following, we give an upper bound on the rank of H. First, we need the following theorem which was 
proved in [32]. 

Theorem 3. Let Mi and M2 be two nxn matrices over GF( q) with ranks remfc(Mi) and rank(M.2), respectively, 
and Mi o M2 be the Hadamard product 0/M1 and M2. Then the rank 0/M1 o M2, denoted by ranfc(Mi o M2), 
satisfies the following inequality: 



rank(M 1 o M 2 ) < ranfc(Mi) x ranfc(M 2 ). (25) 

For the matrices Mi and M2 which are not square matrices, we construct square matrices Mi and M 2 by adding 
extra zero rows or columns. Clearly, adding or deleting zero rows or columns does not affect rank. Then, we have 

rank(M 1 o M 2 ) = rank{M 1 o M 2 ) 

< ranfc(Mi) x rank(M 2 ) = ranfc(Mi) x rank(M 2 ). 

Consider the class = {B **,!} 02 **, ...,B o2C * lti ] of conjugate matrices. It follows from our construction of 
the cyclotomic cosets that ti is the smallest integer in cyclotomic coset Zj. Hence, B oti is the representative matrix 
of the conjugate class 'J/j. If ^ - 1 is contained in the i*th cyclotomic coset Zj. with i* < i, then 

B ot "=BoB o(f '^. (26) 

Since ^ — 1 is an integer in the cyclotomic coset Zj*, B°' ii_1 ' is a member matrix in the conjugate class ^j* with 
representative B oti * where tj» is the representative in the cyclotomic coset Zj* . Since i* < i and ti* < tj — 1, then 
we must have tj. < ti. Since the rank of the matrices in conjugate class "fj. is ^tj», then ranfc(B°(* i-1 )) = jitj*. 
It follows from Theorem 3 that the rank of B oti is upper bounded by /Ui x /Uj. , i.e., 

rank(B oU ) < m x m*. (27) 

Since B oti is an m x n matrix, the rank of B oti must be upper bounded by min{m, n}, i.e., 

rank(B oU ) < min{m,n}. (28) 



January 26, 2013 



DRAFT 



15 



Row index 


Row index 


Cyclotomic coset 


Upper bound 


True rank 


i 


i* 




Mi x Mi* 


Mi 











min{m, n} 




1 







Mi 


Mi 












K-1 











TABLE I 

Recursive construction of cyclotomic cosets 



It follows from (24), (27) and (28) that we have the following upper bound on ran/c(B°* i ): 

rank(B ott ) < min{m, n,\i\ x jj,^}. (29) 

It follows from (24) and (29) that we obtain an upper bound on the rank of the parity-check matrix H which is 
given by the next theorem. 

Theorem 4. Let H be an m x n array of CPM's and ZM's over GF(2) of size ex e given by the e-fold dispersion 
of an m x n matrix over GF(q) with q — 2 r and e = 2 r — 1. Let fi and fi\ be the ranks of B = B°° and B, 
respectively. Then, the following gives an upper bound on the rank of H, 

K-l 

ranfc(H) < p, a + ^ a x min{m, n, mm* }. (30) 

To construct the cyclotomic cosets systematically, we fill a table with k rows and five columns shown in Table 
1. The first column gives the indices of the rows. The entries in the z-th row of the third column are the integers 
in the cyclotomic coset Zj with its representative put in the first position. The first row of the third column gives 
the cyclotomic coset = {0}. The ith entry of the fourth column of the table gives the upper bound fj,\[ii* on 
the rank m of matrices in the conjugate class ^ whose Hadamard powers are integers in the cyclotomic coset 
Zi = {U, 2ti, 2( Ci ~ 1 H i } given in the ith row of the third column. The entry in the ith column of the fifth column 
is the true rank m of the matrices in ith conjugate class The ith entry in the second column of the table is the 
row index i* for which the cyclotomic coset Zj* contains the integer tj — 1. The first entry of the second column 
is set to 0. 

Once the table is formed, we have all the information of the number of integers in each cyclotomic coset and 
the rank of each Hadamard power of the base matrix B. From these information and using (24), we can compute 
the rank of the parity-check matrix H. 

The upper bound on the rank of H is very tight as will be shown by examples given in later sections. If the base 
matrix B has special structures, a combinatorial expression for ranfc(H) can be derived. 

Next we derive an upper bound on ranfc(H) which only depends on the size and the ranks of Bo and B. 
Consider the i-th Hadamard power B°* of the base matrix B for < t < e. Let r(t) denote the number l's in the 
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binary representation of t and /o, A---, /V(t) denote the position of these l's. Then 

r(t)-l 
1=0 

The number r(t) is called the weight of the integer t. Since < t < e = 2 r — 1, we have 1 < r(t) < r. Using 
the above binary representation of t, the t-th Hadamard power B oi of the base matrix B can be expressed as the 
following Hadamard product of B o2/o , B o2h B 02 ^ -1 : 

r(t)-l 

B°* = Yl oB ° 2h C 32 ) 

i=0 

Since each term in the product of (32) is a conjugate matrix of the base matrix B, they are all in the same conjugate 
class with B as the representative and hence they have the same rank [i\ as B. It follows from Theorem 3 and 
(32) that the rank of B ot is upper bounded as follows: 

rank(B ot ) < nl m . (33) 

Since for < i < r, there are ( r j nonzero integers less than e = 2 r — 1 with weight i. Then it follows from (19) 
and (33) that we derive the following theorem that gives an upper bound on the rank of an array of CPMs and/or 
ZMs of size e x e. 

Theorem 5. Let H be an m x n array of CPM's and ZM's over GF(2) of size e x e given by the e-fold dispersion 
of an m x n matrix over GF(q) with q — 2 r and e = 2 r — 1. Let [j,q and fix be the ranks of Bo = B°° and B, 
respectively. Then, the rank of H is upper bounded as follows: 

r-l 



ranfc(H) < fi a + \] [ . ) min{m, n, fj,\}. (34) 



i=l 

The upper bound given by (l34l depends only on the choice of the base matrix B. For several class of 2 x 2 
SM-constrained base matrices, this bound is very tight. This will shown in latter sections on code construction. 

B. Row Redundancy 

A very important structure of the geometrically and algebraically constructed cyclic or QC-LDPC codes is that 
their parity-check matrices have large row redundancies, i.e., the parity-check matrix of a code has a large number 
of dependent rows. Extensive simulation results show that large row redundancy and large minimum distance make 
the iterative decoding of an LDPC code to converge at a very fast rate and provide a very low error-floor. Here 
we would like to show the impact of row-redundancy by an simple example of the (255, 175) EG-LDPC code 
given in iflOl . From Figure 1, it is clear that the performance of the SPA decoding algorithm of the EG-LDPC code 
improves as the row-redundancy of H increases. The performance of H with all row-redundancy 0.6863 is about 
0.6 dB better than the performance of H with no row-redundancy at bit error rate (BER) 10~ 5 . 

It is interesting that such regular algebraic LDPC codes are generally better than regular LDPC codes designed 
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Fig. 1. The performance of the (255, 175) EG-LDPC code given in QJj]. 

by pseudo-random matrices [16], [19]. However, irregular algebraic LDPC codes perform close to irregular pseudo- 
random LDPC codes. We call two Tanner graphs similar if they have the same girth and degree-distributions. It is 
well known that the same message-passing algorithm [12] performs closely under two similar Tanner graphs at the 
same signal power per code bit to noise ratio (SNR c b). Without loss of generality, suppose that the parity-check 
matrix of the first code has redundancy and the second does not. Thus, the null space of the first one defines a 
higher-rate code than the null space of the second one. Therefore, the first code requires lower signal power per 
information bit to noise ratio (SNR) than the second code to achieve the same performance. In another word, the 
redundancy will improve the performance of LDPC codes. Most regular algebraic LDPC codes have redundancies, 
but most irregular algebraic LDPC codes have no redundancies. Thus, we see this interesting phenomenon from 
simulations. 

Definition 1. Let H be an m x n matrix over GF(2). Let ranfc(H) denote the rank ofH. The row redundancy H 
is defined as the ratio £ = (m — rank(H.))/m. IfiL has full rank, i.e., rank(H.) = m, then its row redundancy is 
zero. 

It follows from the above definition that m — ranfc(H) is simply the number of redundant rows (or dependent 
rows) of H. 

The parity-check matrix H obtained by e-fold array dispersion of a 2 x 2 SM-constrained base matrix B is, in 
general, not full rank and in fact, has a large number of redundant rows. Using the upper bound on the rank of the 
parity-check matrix H given by (34), we obtain the following lower bound on the redundant rows of H, denoted 
fl(H): 

i?(H) < me — po — J]] ( . ) x min{m, n,p\}. (35) 

i=l 

RC-constrained parity-check matrices of QC-LDPC codes with large row redundancies have been reported in [20]- 
[25]. These parity-check matrices are all constructed by array dispersions of 2 x 2 SM-constrained base matrices 
using finite fields. They are arrays of CPMs and/or ZMs. In the next section, several classes of these base matrices 
will be briefly described. 
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Most high-rate QC-LDPC codes in applications have small m, since code rate is lower bounded by 1 — m/n. 
Thus, is larger than min(m, n) with a small r(t). Thus, we consider all B°*'s have full rank, except for 

t = and t = 1,2,2 2 ,--- ,2 C1 ~ 1 . Recall that c t is the smallest positive integer satisfying t2 Ct = taiode. Since 
e = 2 r — 1, ci = r. In this case, B and B 0T (*) with small r(i) are the key factors to design parity-check matrices 
with redundancies. Without loss of generality, suppose m < n. Then, we give the next two Corollaries. 

Corollary 1. If the parity-check matrix H consisting of circulants and zero matrices of size e is binary and the 
rank of its base matrix rank(B) = then the redundant rows o/H is at least r(m — /ii). 

Proof: Considering all B°*'s have full row-rank, except for t = 1, 2, 2 2 , • • • , 2 r_1 , from (35), we have 

r-1 

i?(H) > me - {i - Q min{m, n, fi\}, 
»=i 

> (m-/zi)r. 

■ 

Corollary 2. If the parity-check matrix H consisting of circulants and zero matrices of size e = 2 r — 1 is binary 
and its base matrix does not have zero entry, then its rank ranfc(H) is at most m(e — 1) — ci(m — ri) + 1. 

Proof: If all entries of B are nonzero, then B is all l's. Thus, fi = !■ Then i?(H) > r(m — p,\) + m — 1. ■ 
The above two Corollaries give us two guidelines to design parity-check matrices with redundancies. First, the 

base matrix B should have rank as small as possible. Second, it should contain few zero entries. 

Similarly, from (19), we can give a bound for the non-binary QC-LDPC codes whose parity-check matrix is an 

array of a-multiplied CPMs and zero matrices. 

Corollary 3. If the parity-check matrix H a consists of an array of a-multiplied CPMs and zero matrices of size 
e = 2 r — 1, then there are at least r(m — H\) redundant rows. 

VI. Rank Enumerations of Two Well Known Classes of RC-Constrained Low-Density Arrays 

of CPMs 

In this section, we consider two well known classes of 2 x 2 SM-constrained base matrices. From these two 
classes of base matrices, two classes of RC-constrained arrays of CPMs and/or ZMs can be constructed. The null 
spaces of the arrays in these two classes give two classes of RC-constrained QC-LDPC codes. 

A. Latin Squares 

A Latin square of order n is an q x q array for which each row and each column contains every element of a 
set of n elements exactly once [29]. For any given field GF(q), there is a q x q Latin square whose entries are 
elements of the field. In a recent paper [23], it was proved that a Latin square over the field GF(<?) satisfies the 
2x2 SM-constrained and hence can be used as a base matrix for constructing a q x q RC-constrained array Hj ot 
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of CPMs and ZMs of size (q — 1) x (q — 1). The null space of any subarray of H/ at gives an RC-constrained 
QC-LDPC code. Using the recursive algorithm and bounds developed in Section V, we can enumerate the rank of 
any subarray of H; af . 

Consider the field GF(g) where q — 2 r . Let a be a primitive element of GF(g). Then, a~°° — 0, a = 1, 



a, or, a 



9-2 



give all the elements of GF(q). The following qx q matrix over GF(q) gives a Latin square of order 



B 



lat 



1 - 1 

a - 1 



1 — a 

a — a 



a — a 



v9- 2 



9-2 



v9"2 



0-1 



- a 



- oP~ 2 



1 - 
a - 

a*- 2 - 
0-0 



(36) 



The entries on the main diagonal of B; at are the 0-element of GF(g). This matrix satisfies the 2x2 SM-constrained 
and hence can be used as a base matrix for code construction. 

For 1 < m.n < q, let B/ at (m,n) be an m x n submatrix of B; at , taken from the upper-left corner of B; at . 
Let H; at (m,n) be an m x n subarray of H/ at , obtained by the e-fold dispersion of B/ at (m, n). H; at (m, n) is an 
me x ne matrix over GF(2). Then, the null space of H; at (m, n) gives a QC-LDPC code of length ne. If Hi at (m, n) 
does not contain any ZM of H; at , it has constant column and row weights m and n, respectively. Then the QC- 
LDPC code given by the null space of H/ at (m,n) is an (m,n)-regular QC-LDPC code. If H; at (m,n) constains 
ZMs of H; at , then Hi at (m,n) has two different column weights, m — 1 and m. In this case, the null space of 
H/ a t(m, n) gives a near-regular QC-LDPC codes. 

In [9], a combinatorial expression of the rank of H/ Qt (m, n) have been given for the case of n = q. In this section, 
we will generalize this combinatorial expression to make it suitable for the case of either m > | or n > |. We 
will also show that in this case, the equality of the upper bound specified in d34l i holds. Since B/ at is a symmetric 
matrix, we only need to give the proof for the case of n > |. 

Define the index sequence A = (0, 1, 2, q — 2, —oo), and let A m , A n denote two index sets consisting of the 
first m and n components of A, respectively. Then for 1 < t < 2 r — 1 we have B^ ( (m, n) — [(a 1 +a : ') t ]i < zA m .jeA n - 
Since the characteristic of GF(q) is 2, in the binomial expansion of (a 1 +a : >) f , only the terms with odd coefficients 
exist. Let t be the number of odd coefficients in the binomial expansion of (a 1 + a J )' (or the number of odd 
integers in the i-th level of Pascal triangle). Let l\, I2, le t denote the positions of these odd coefficients. We note 
that h — and l 6t = t. It is clear that 9 t <t + l. Then 



(a' + a j f = a lt + a l{t ' h) a jh + a i{t ~ h) a jh + ... + a l(t ^ le ^ ] a jh ^ + a jt 



(37) 



Let 7 m and 7„ denote the m-th and n-th component in the index sequence A repectively. Based on the expression 
given by yT}, the t-th Hadamard power l$i* t (m,n) can be expressed as a product of two matrices as follows: 



B °at( m > n ) = V t , L {m,n)Yt,R{rn,ri) 



(38) 
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a 2 * 
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a lm(t-h) 
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1 1 
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1 








a° a' 2 


a 2 ' 2 • • • 
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V tj jj(m,ra) = 


a a' 3 


a 2h . . . 


a 7 " 


h 






a 


U 2l »t ■ . . 


a 7„ 





(39) 



where Vt,L is a m x P f matrix over GF(2' r ) and Vt,R is a # f x n matrix over GF(2 r ). 

Let Lu(t) be the number of nonzero terms in the radix-2 expansion(or binary representation) of t , called the 
radix-2 weight of 9 t . It follows form Lucas theorem [29] that t = 2 W W . For < t < 2 r - 1, since 9{t) <t+K2 r , 
we must have tj(t) < r and 9 t < 2 r ~ 1 = |. Since n > |, we conclude that t < n. 

Based on the structure of the two matrices Vf ,2,(771, n) and V t jj(m, n), we readily know that both of them can 
be transformed into Vandermonde Structure by elementary row and column operation. In this case we know that 
Vt^m, n) has full row rank, i.e. rank(Vt,R(rn, n)) = 6t, and rank{Vt,h{ m , n )) — min{m, 8t} = min{m, 2 W (*)}. 
Thus we have 

rank(B°Q t (m, n)) = ranfc(Vt i i(m, n)V t ,fl(?7i, n)) = ranfc(V t ,i(m, n)) = min{rn, 2 W ^} (40) 
Then based on (fPfl) it follows that 



mfc(H; at (rn, n)) = ranfe(B^ t (m, n)) + ranfc(B°* ( (m, n)) 

2 r -2 

ranJfc(B°° t (m,ra)) + min{m, 2 u(t) } 
t=i 

/io(m, n) + ^2 ( ■ ) min{m, 2 1 } 



»=i 



where fj, (m,n) — ranfc(B^ t (m, ri). On the other hand, it follows from ( |34l l that 



r-l 



rank(Hi at (m, n)) < jUo(to, n) I . j min{m, n, ((J,i(m, n)) 1 } 



(41) 



where /xi(m, n) = rank(Bi a t(m,n)). It follows from d40l i that ranfc(B; a t(m, n) = min(m, 2) = 2 (We never 
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choose m = 1 for code construction). Thus ((34) becomes 

rank(Hi a t(m, n)) < jtto(TO,n) + ( . J min{m, n, 2 1 } (42) 

i=i 

Since min{m, n, 2 4 } < min{rt,2 1 }, comparing d4TT > and d42l we see that the equality in (l42l must hold. Let 
w m be the largest integer such that 2" m < to, then another combinatorial expression of rank(H.i at (m,n)) can be 
derived based on fiH : 



r-1 

' r 



rank(Hi at (m,n)) = fx (m,n) + ^ ( j min{m,2'} 

i— 

= /x (m, n) + ^ 2 g + m 

l<*<r-l l<i<r-l 
2' i <m, 2'i>m 



= /i (m,n)+ 51 2 ,: + ^ to (43) 

i—l i— cj m + l 

where the second sum term exists only if ui m + 1 < r — 1. The rank expression in (l43l is suitable for the case of 
n > |. For the case of to > |, based on d43b and the fact that B/ Qt is a symmetric matrix we can directly obtain 
the combinatorial expression of rank(Hi at (m, n)) as follows: 

minjo;^ ,r— 1 } r— 1 

ran/c(H /Qt (TO,n)) = fj. a (m,n) + ^ 2 l + ^ n (44) 

z— 1 i— aj^+l 

where w„ is the largest integer such that 2"" < n, and the second term exists only if u> n + 1 < r — 1. 

Using d43l and d44l ). we can yield some more interesting result with respect to some special case. Firstly we 
consider the case that m = n > |. In this case we have min{o; m ,r — 1} = min{aj m+ i,r — 1} = r — 1, and the 
second sum term of ( |44T > doesn't exists. Thus we have 

rank(Hi at (m + 1, m + 1)) — rank(Hi at (m, to)) = /!o(to + 1, to + 1)) — /io(ro, to)). 

Since it has been known in lf25l that if ko denote the number of O's in B ; °° t (TO, n), we have 

fco + 1 if fco < min{m, n}, 
^o(m, n) = ^ fc - 1 if fco = n = m is odd, (45) 
fco otherwise. 

Based on (05]), we readily know that for even to, /j,o(m+l, m+1) = fJ,o(m, to), and for odd to, /!o(to+1, to+1) = 
/Lto( m ) m ) + 2. Thus we have the following recursive relationship in the case of to > |: 

, rank(JrL] nt (m,m)) if to is even, 

/•onfc(H lot (m + l,m+l)) = < V V " (46) 

rank(H.i a t(m, m)) + 2 if to is odd, 
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Secondly in the case of n < |, we consider two subarrays H/ Qt (g,n) and H; at (|,n). In this case, we have 
min{w 9 , r — 1} = min{o;a , r — 1} = r — 1, and the second sum term of (144-b doesn't exists. Hence based on (l44t 
we have 

rank(H lat (q,n)) - ronfc(H tet (-, n)) = ^o{q,n) - /x (|,n). 

Since n< %, based on ( |45T > we conclude that /io(<Z, n) — ^o(|, n). Hence in case of n < f we have 

rank(Hi at (q,n)) = ranfc(H iat (|, n)) (47) 

equation ( |47] i indicates that in the case of n < |, all the last ^~ 1 - >g rows of H/ at (g,rt) are redundant rows, hence 
the null spaces of Hi at (q,n) and H; a4 (|,n) give the same QC-LDPC codes. 

Thirdly in the case of n > |, we consider two subarrays Hi at (q,n) and H; at (n,n). In this case we have 
mm{uj q , r — 1} = min{cj n , r — 1} = r — 1, and the second sum term of (l44l doesn't exists. Hence based on (144-b 
we have 

rank(Hi at {q,n)) - rank(Hi at (n,n)) = Ho(q,n) - ^o(n,n). 

It follows from (f45b that /io(? 5 = ^> an d that /io(«, n) = n — 1 for odd n, and ^o(n, n) — n for even n. Hence 
in case of n < | we have 

!ranfc(H; ai (n,n)) if n is even, 

(48) 
rank(Hi at (n,n)) + 1 if n is odd, 

equation d48l indicates that in the case of even n > I, all the last (g — l)(q — n) rows of H/ Qt (g, n) are redundant 
rows, hence the null spaces of Hi at (q, n) and H; a4 (n, n) give the same QC-LDPC codes. 

Suppose we take m — n = q, i.e. we use the whole matrix H; ai as the parity-check matrix, H; af has 2 r (2 r — 
1) — 3 r + 1 = 4 r — 3 r — 2 r + 1 redundant rows, which satisfies the equality in (35). For r > 4, the number of 
redundant rows is very large. The null space of Hj at gives an RC-constrained (4 r — 2 r , 4 r — 3 r — 2 r + 1) QC-LDPC 
code with minimum distance at least 2 r + 1, whose Tanner graph has a girth of at least 6. 

Example 1. Consider the 64 x 64 Latin square constructed based on GF(2 e ) using the form of (36). It is a 64 x 64 
matrix over GF(2 6 ). We use this matrix as the base matrix B; t. Hence m = n = 64 and e — 63. The 63-fold 
array dispersion of B; at gives a 64 x 64 array H; at of CPMs and ZMs of size 63 x 63 with the ZM's lying on the 
main diagonal of H; af . H; at is a 4032 x 4032 matrix with both column and row weights 63. Hence the code has 
minimum distance at least 64. The rank o/Bi at is 2 and the rank o/Bq is 64. Table 2 gives the cyclotomic cosets 
of 2 modulo 63 and the ranks of the conjugate matrices o/B; a i and their bounds. There are 13 cyclotomic cosets 
of 2 modulo 63 and hence the 63 Hadamard powers of the base matrix B; a4 are grouped into 13 conjugate classes. 
From Table 2, we see that for < i < 13, the upper bound fJ-ifii* is equal to the true ranks of matrices in the 
conjugate class "I^. It follows from (24) that ranfc(H; ai ) = 728 which is exactly equal to 3 6 — 1. This shows that 
the bound given by (30) (or the bound given by (34)) is tight. The parity-check matrix H; at has 3304 redundant 
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Row index 


Row index 


Weight 


Cyclotomic coset 


Upper bound 


i i 

Irue rank 


i 


i* 


r(i) 


Zi 




Ui 





N/A 


N/A 





N/A 


N/A 


1 


1 


1 


1 2 4 8 16 32 


2 


2 


2 


2 


2 


3 6 12 24 48 33 


4 


4 


3 


2 


2 


5 10 20 40 17 34 


4 


4 


4 


3 


3 


7 14 28 56 49 35 


8 


8 


5 


2 


2 


9 18 36 


4 


4 


6 


2 


3 


11 22 44 25 50 37 


8 


8 


7 


3 


3 


13 26 52 41 19 38 


8 


8 


8 


5 


4 


15 30 60 57 51 39 


16 


16 


9 


4 


3 


21 42 


8 


8 


10 


7 


4 


23 46 29 58 53 43 


16 


16 


11 


8 


4 


27 54 45 


16 


16 


12 


9 


5 


31 62 61 59 55 47 


32 


32 



TABLE II 

Cyclotomic cosets of 2 modulo 63 and the ranks of the conjugate matrices of the base matrix B Jat . 



rows and a redundancy £ = 0.8194. The performances of this code over AWGN channel decoded with 5, 10 and 
50 iterations of the SPA are shown in Figure 2. We see that decoding of this code converges very fast. At the BER 
of 10~ 6 , the performance gap between 5 and 50 iterations is about 0.1 dB. The performance curves for 10 and 50 
iterations almost overlap. Also at the BLER (block error rate) o/10 -5 , the code decoded with 10 iterations of the 
SPA performs 1.2 dB from the sphere packing found. 

Example 2. Choose m — 6 and n = 64. Choose the first 6 rows of 64 x 64 matrix over GF(2 ) constructed in 
Example 1 as the base matrix, denoted B; at (6, 64), for code construction. B; at (6, 64) contains 6 zeros, one in each 
of the first 6 columns. Array dispersion of this base matrix gives a 6 x 64 array H; at (6,64) of CRM's and ZM's 
of size 63 x 63. This array is a 378 x 4032 matrix over GF(2) with row weight 63 and two column weights 5 (315 
columns) and 6 (3717 columns). Using the upper bound on ranfc(B/ at (6, 64) oti ) given by (34), we find that the 
rank o/Hj at (6, 64) is upper bounded by 324. However, the actual rank o/H cpTOi ; ot (6, 64) is also 324. Therefore, 
the bound gives the actual rank o/H/ at (6, 64). The matrix H cprrl: / at (6, 64) has 54 redundant rows. The null space 
of the array H; at (6,64) gives a (4032,4708) QC-LDPC code with rate 0.92. The error performances of this code 
over the AWGN channel decoded with 5, 10 and 50 iterations are shown in Figure 3. 

Example 3. Consider the 6 x 64 array constructed in Example 2. Each of the first 6 column blocks contains a 
single ZM. If we remove the first 6 column blocks of the array, we obtain a 6 x 58 subarray H; ai (6,58) of the 
entire 64 x 64 array H iat constructed in Example 1. The subarray Hj ot (6, 58) is a 378 x 3654 matrix over GF(2) 
with column and row weights 6 and 58, respectively. Using the upper bound on ran/c(B; at (6, 58)) given by (34), 
we find that the rank o/H; at (6, 58) is upper bounded by 324. 
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B. Vandermonde Matrices 

A special type of Vandermonde matrices also satisfies the 2 x 2 SM-constraint. Again, we consider the field 
G¥(q) with q = 2 r . Let p be the largest prime factor of q — 1. Let k be the integer such that q — 1 = kp. If q — 1 
is prime, then p = q — 1 and k = 1. Let a be a primitive element of GF(q) and (3 = a k . Then, the order of /3 is p. 
Form the following pxp matrix over GF(q): 



B, 



1 1 1 1 

1 /3 ••• pp- 2 (3P- 1 

1 ^p- 1 ... ) g(p-i)x(p-2) ^(p-i)x(p-i) 



(49) 



It can be readily proved that B„ „ satisfies the 2 x 2 SM-constraint and hence can be used for constructing 
RC-constrained QC-LDPC codes. The rank of B„ a „ is p. In fact, all Hadamard powers of B„ on , B°^ n = 
B„ on ,B°^ n , . . . ,BSi« _1 \ have the same rank p since p is a prime. Since all the entries of B„ on are nonzero 
elements of GF(q), all the entries of B°"„ are l's. Consequently, rank(B°" n ) = 1. 

The CPM array dispersion of B„ a „ results in a p x p array H„ a „ of CPMs of size e x e with e = 2 r — 1. It is 
a pe x pe matrix over GF(2) with both column and row weights equal to p. It follows from (19) that the rank of 

rank(U van ) = 1 + (p - l)p. (50) 

The row redundancy is then ^(H„ a „) = (2 r — p — 1) / (2 r — 1). In case q— l = 2 r — lisa prime, then rank(H van ) = 
1 + (2 r - 2)(2 r - 1). 

For 1 < m,n < p and m < n, let TS van (m,n) be an m x n submatrix of B^n which is still a Vandermonde 
matrix with rank m. The ranks of B°^ n (m,n) = H van (m, n), B^ n (m, n), B^i^ 1 (m, n) are m. The rank 
of B°° n (m, n) is 1. The CPM array dispersion of B t)an (m, n) results in an to x n array H„ on (m, n) of CPMs of 
size e x e. It follows from (19), the rank of H van (m, n) 

rank(H van (m,n)) = mp — m + 1. (51) 

The null space of H„ an (m, n) gives an RC-constrained (m,n)-regular QC-LDPC code of length n(2 r — 1). If n = p, 
the base matrix B„ a „(m,p) is actually the parity-check matrix of a non-primitive RS code over GF(q). 

VII. Construction of QC-LDPC Codes Based on Random Partition of Finite Fields and its Rank 

Analysis 

In this section, we present a new algebraic method for constructing a class of QC-LDPC codes. Given a finite 
field, we first partition the elements of the field into two disjoint subsets (any partition). Based on these two disjoint 
subsets, we form a matrix over the given field. Every entry of the matrix is a sum of two elements, one from one 
subset and the other from the second subset. From this matrix, we can form an array of CPMs. This array, as a 
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matrix, satisfies the RC-constraint. Then, the null space of this array gives a QC-LDPC code. 



A. A Class of 2 x 2 SM-Constrained Base Matrices Constructed by Field Partitions 

Let GF(2 r ) be a finite field with 2 r elements which is an extension field of the binary field GF(2). Let a be 
a primitive element of GF(2 r ). Then, the powers of a, a~°° = 0, a = l,a,a 2 , ...,o? T ~ 2 , give all the elements 
of GF(2 r ) and a 2 ^ 1 = 1. Let m and n be two positive integers such that m + n = 2 r . Partition the elements 
of GF(2 r ) into two disjoint subsets, G\ = {A , Ai, A TO _i} and G2 = {So, £>i, 5 n -i}, i-e., G\ UG2 =GF(2 r ) 
and Gi fl G 2 = 4>- Form the following m x n matrix over GF(2 r ): 



B r 



Ao + S a 
Ai +S 



A + S X 
X 1 + S 1 



Ao + S n -\ 

Ai + £„_i 



A m -i + So A m _i + S\ 



A 



m— 1 



+ s n - 



(52) 



We note that each row of B rp is formed by adding an element in Gi to all the n elements in G 2 and each column 
of B rp is formed by adding an element in G 2 to all the m elements in G\. Since the characteristic of the field 
GF(2 r ) is 2, every element in GF(2 r ) is its own additive inverse. It follows from the fact that G\ and G 2 are 
disjoint and the formation of B rp , we readily prove that: (1) all the entries in B rp are nonzero; (2) all the entries 
in a row of B rp are different; and (3) all the entries in a column of B rp are different. Every entry in B rp is a 
power of the primitive element a of GF(2 r ). In the following, we prove that the m x n matrix B rp over GF(2 r ) 
given by (1) satisfies the 2 x 2 SM-constraint. Hence, B rp can be used as the base matrix to construct an m x n 
RC-constrained binary array of CPMs. 

Theorem 6. The m x n matrix B rp over GF(2 r ) given by (1) satisfies the 2 x 2 SM-constraint. 

Proof: Since all the entries of B rp are nonzero. To prove the theorem,we only need to prove that every 2x2 
submatrix is non-singular. Consider a 2 x 2 submatrix of B rp : 



Q 



(53) 



Aj + 5k Aj + S t 
Xj + S k Aj + S t 

where < i,j < m and < k, t < n and i ^ j and k ^ t. Since i ^ j and k ^ t, then Aj 7^ Aj and S t ^ 5k. If 
this matrix is singular, then 

(A, + 5 k )(Xj + S t ) - (Xi + S t )(Xj + 5 k ) = 0. 

Manipulating the above equality, we have (Aj — Xj)(5 t — Sk) = which implies either Ai = Aj or St — 5k- This 
contradicts the fact that Aj ^ Aj and S t ^ Sk- Therefore, any 2x2 submatrix Q of B rp is non-singular. This proves 
the theorem. ■ 
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B. Construction of Codes 

Since the base matrix B rp over GF(2 r ) satisfies the 2 x 2 SM-constraint. It can be used to construct an m x n 
RC-constrained binary array H rp of CPMs and ZMs. Since each entry in B rp is a nonzero element in GF(2 r ), it 
must be a power of a which is a primitive element of GF(2 r ). Label the rows and columns of a (2 r — 1) x (2 r — 1) 
CPM from to 2 r — 2 which correspond to powers of a, a° — 1, a, a 2 , a 2 ~ 2 . For < i < m and < j < n, 
let Xi + Sj = a ki ' j with < fcjj < 2 r — 1. Then the construction of H rp directly from B rp is carried out as follows: 
replacing the entry A, + 8j = a ki - } at the «th row and jth column of B rp by a (2 r — 1) x (2 r - 1) CPM whose top 
row (called the generator) has a single 1 -component at the position kij. This gives the array H rp corresponding 
to the base matrix B rp . Since all the entries are nonzero, H rp contains no ZM and is an array of CPMs only. 

H rp is a m(2 r — 1) x n(2 r — 1) matrix over GF(2). Since each CPM has both column and row weights equal to 
1, the column and row weights of H rp , as a m(2 r — 1) x n(2 r — 1) matrix over GF(2), are m and n respectively. 
Consequently, the null space of H rp gives an RC-constrained QC-LDPC code of length n(2 r — 1) with minimum 
distance at least m + 1 whose Tanner graph has a girth at least 6. Note that the null space of any sub-array of H rp 
also gives a QC-LDPC code. 

C. Rank Analysis of the Parity-Check Matrices 

Next we will analyze the rank to show that the resulting parity-check matrix is rich in redundant rows and satisfies 
the two guidelines derived from Corollary 1 and 2. First, because there are no zero elements in B rp , Bo is an all 
'1' matrix and has rank /i = 1. Second, if we rewrite B rp as the product of two matrix, 

B rp = ViVjj, 



where 



V L = 



Ao 1 
Ai 1 
A 2 1 



A 



m — 1 



i 



and 



1 1 1 

Co Ci c 2 



5n-l 



are full row-rank and full column-rank, respectively, it is clear that the rank of B rp is small fi\ — min{m, n, 2}. 
From Theorem 5, an upper bound on the rank of H rp can be given from the base matrix B rp , 

r-l 



ranfc(H rp ) < ^ + ^ ( . j min{m, n, 



r-l 



< 1 + ( • ) min{m,n,2 4 } 



(54) 



In the above section, we show that this bound is very tight and in some cases the equality holds. Here we will 
show that for parity-check matrices constructed based on random partition, the equality holds again in some special 
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cases. Here we only give the proof for the case m < n. If m > n, the proof is similar. 

For < t < 2 r — 1, we have B°* = [(A.; + Sj)*], < i < m and < j < n. In the binomial expansion 
of (A; + Sj) 1 , only the terms with odd coefficients exist since the odd coefficients modulo-2 are equal to 1 while 
even coefficients modulo-2 become zeros. Let 8 t be the number of odd coefficients in the binomial expansion of 
(Xi + SjY (or the number of odd integers in the <-th level of Pascal triangle). Let l±, I2, le t denote the positions 
of these odd coefficients. We note that li = and lg t = t. It is clear that 6 t < t + 1. Then 

(A* + Sj) 1 = + Xl h S l ; + Xl~ h S l f + ... + A*^- 1 5**- 1 + 8) (55) 

Based on the expression given by (l55l l. the i-th Hadamard power can be expressed as a product of two matrices 
as follows: 

B°; = V t . L V t . R (56) 

with 



A* 


\t-i 2 


yt-l 3 


• 1 


A' 


x[- h 


A 4 r' 3 • 


• 1 


A2 


A 2 


\t-; 3 

A 2 


• 1 



A m-1 


A m-1 




• • • 1 




1 


1 


1 •■• 


1 




sh 
°0 




°2 


°n-l 




S h 
"o 




A«3 . . . 
°2 


°n-l 









a' 9 * . . . 

°2 


°n-l 



where V t ^ is a m x t matrix over GF(2 r ) and V t .n is a 6 t x n matrix over GF(2 r ). Let be the number of 
nonzero terms in the radix-2 expansion(or binary representation) of 8 t , called the radix-2 weight of 9 t . It follows 
form Lucas theorem [29] that 6 t = 2 u( -*\ For < t < T - 1, since B(i) < t + 1 < 2 r , we must have w(t) < r and 

9 t < 2 r - x . 

To determine the rank of B°* , we need to determine the ranks of ~Vt,L and ~Vt,R- This can be done with the 
following case: the nonzero elements of both G\ and G2 form two sequences of consecutive powers of a. The 
element can be in either G\ or G2. For example, G\ — {0, a , a, a m ~ 2 } and G2 = {a" 1 ^ 1 , a m , a 2 ' ~ 2 }. 
Let n — 2 r — m. We also assume that m < 2 r ~ 1 < n. In this case, "Vt,L an d Vt,R can be transformed into 
matrices with the Vandermonde structure [27], [28] by elementary column and row operations. Since m < n, 
then n > 2 r ~ 1 > 9 t . As a result, rank(V = min(m,8 t ) and rank(Vt,R) = @t- It follows from ( f56T > that 
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ranfc(B°* ) = rank(Vt,LVt,R)- Since Vt,R nas full row rank, 

rank(B° P ) = rank(V tl LVt,B.) = ranfe(V t>i ) = min(m, 9 t ) (58) 
for < i < 2 r - 1. Since ran/c(B°°) = /i = 1. Then, it follows from (19) that the rank of H rp is: 



2 r -2 



mk(H rp ) = 1 + E rank {^ rp) 
t=l 

2 r -2 

1 + min(m, 6t) 
t=i 

1 + ^ ( r .)min(m,2 l ) 



Therefore, the equality in (154t holds. Let u>o be the largest integer such that 2"° < m ,Then another combinatorial 
expression for the sum terms given by (l59~t can be derived as follows: 



2-2 



ranfc(B°p) = min(rn,6t 



= E ™+ E 



1=1 

ft 



l<t<2 r -2 l<t<2' r -2 
w <w(i) ^ >^(*) 

m— 1 cjq 

- E E ™+E E 2" (t) 

«o+l»(t)=u u=la)(t)=« 

- e (;W£(;V 

r—1 / \ r — 1 / \ r — 1 

r \ sr^ I t \ nUJ \— \ f r 



- E >+ECK" E CI' 

Note that EL=i C) 2 " = 3 r - 2 r - 1. Consequently, we have 



2 r -2 r-1 

' r 



£ ronfc(B°* ) = 3 r - 2 r - 1 - £ (J(2 w -m). (59) 

t— 1 w=a?o+l 



Since ranfc(B°p) = 1, we have the following combinatorial expression for the rank of H rp with m < 2 r 1 : 

rank(U rp ) = 3 r - 2 r - ^ (^^-m). (60) 

For m = 2 r_1 = n, B rp is a square matrix, denoted by B rP;S and its corresponding array H rp s is a 2 r ~ 1 x 2 r_1 
array of (2 r - 1) x (2 r - 1) CPMs. In this case, oj = r - 1 and 

ranfc(H rp , s ) = 3 r - 2 r . (61) 

The null space of H rp , s gives a binary QC-LDPC code with the following parameters: (1) length n = 2 r ~ 1 (2 r — 1); 
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Fig. 2. The Error Performance of QC-LDPC code given in Example 4 

(2) dimension k — 2 2r ~ x — 3 r ; (3) minimum distance d m i n is at least 2 r_1 + 1. The null space of any sub-array 
of H rp s gives a QC-LDPC code. 

Example 4. Let GF(2 6 ) as the field for construction. Let a be a primitive element of GF(2 6 ). Partition GF(2 6 ) 
into two subsets, G\ = {0,1, a, a 2 , a 3 , a 4 } and G2 = {a 5 , a 6 , a 62 }. Using these two subsets of GF(2 e ), we 
can construct a 6 x 58 base matrix B rp over GF(2 6 ). Array dispersion of this base matrix results in a 6 X 58 array 
H rp of 63 x 63 CPMs. H rp is a 378 x 3654 RC- constrained matrix over GF(2) with column and row weights 6 
and 58, respectively. Since m = 6, we find that uq — 2. Using the combinatorial expression given by H60h we find 
that the rank ofH rp is 319. Hence, the null space ofH rp gives a (6,58)-regular (3654,3335) QC-LDPC code with 
rate 0.9126. The bit and block error performances of the code decoded with 5, 10 and 50 iterations of the MSA are 
shown in Figure 2. We see that the decoding of the code converge fast. At the BER of 1CP 6 , the code decoded with 
50 iterations of the MSA perform 1.2 dB from the Shannon limit. At the BLER (block error rate) 10~ 5 , it performs 
0.8 dB from the sphere packing bound. 

Similarly, by replacing each entry of B rp by a-multiplied CPM's, we can construct non-binary RC-constrained 
arrays H a rp over GF(2 r ) based on field partitions. The null spaces of these arrays give a class of non-binary 
QC-LDPC codes. 

Example 5. Let GF(2 b ) be the field for code construction and a be a primitive element of the field. Partition the 
elements of GF(2 5 ) into two disjoint subsets, G\ = {0,1, a, a 2 } and G2 = {a 3 , a , a 30 }. Based on these two 
subsets ofGF(2 5 ), we form a 4 x 28 base matrix B rp over GF(2 5 ) of the form given by (40). Replacing each entry 
in B rp by its corresponding a-multiplied CPM of size 31 x 31, we obtain a 4 x 28 array H a rp of a-multiplied 
CPMs of is a 124 x 868 RC-constrained matrix over GF(2 5 ) with column and row weights 

4 and 28, respectively. Since m — 4, the parameter wq is 2. Using the combinatorial expression given by (48), 
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Fig. 3. The Error Performance of QC-LDPC code given in Example 5. 

we find that the rank o/H Q rp is 111. The null space ofH a rp gives a (4, 28) -regular 32-ary (868,757) QC-LDPC 
code with rate 0.8722. The bit, symbol and block error performances of this code decoded with 50 iterations of fast 
Fourier transform q-ary SPA (FFT-QSPA) are shown in Figure 3. At the BLER o/10 -5 , the code performs 1.72 dB 
from the sphere packing bound. 



A. QC-LDPC Codes by Diamond-Shape Dispersion 

The construction of QC-LDPC codes, diamond-shape dispersion, is first mentioned in [16], which have good 
performance and are well-known for correcting single burst erasures. In this subsection, we will put it into a more 
general form such that its degree distributions and dispersion size are more flexible and its rank is possible for 
analysis. In addition, we will propose a construction method which leads to more row redundancy from the two 
guidelines. 

Let W be an m w x n w base matrix over GF(q) with rank /i w , where q — 2 r , n w > 2 and m w is a factor of 
n w = c w m w . We divide it into two parts: the upper matrix W M , where 



VIII. New Constructions of QC-LDPC Codes 




(62) 



and the lower matrix Wj, where 




(63) 
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such that W = W u + Wj. Then we form a new m x n base matrix 



W, ' w. 



(64) 



where m = 2m w and n = 2n w . The parity-check matrix H cpnit d s is the e-fold dispersion of the base matrix B^s, 
where e = 2 r — 1. Since 



ranfc(Brf s ) = rank 

the rank of is at most p, w + m w . Considering its i-th Hadamard power, 

Wf* 



w„ + w ; ! w, + w„ 




W 


i w 




^ = rank ^ 






W, i w„ 

1 




Wj 


1 



rank(Ti ds ) — rank 



W ot - 

* y u 

W°* 



w° 



rank 



W * i W ot 
1 

W °t I W °t 



(65) 



From (33), we have the rank of B^* is at most ^(t) + m w . Thus, assuming m < n, from Theorem 5, 



ik(H cpmt ds) < Mo + ^2 (j) min { 2m «" ML + m w}- 



Thus, there are at least 



r-l 



i?(H cpm>ds ) > (2m™ - Mo) + I . ) min{0, - p, z w } 



»=i 



(66) 



(67) 



redundant rows. Similar to Corollary 3, suppose that W contains all nonzero entries, i.e., ^ = m w + 1, such that 
H C p mit i s have more redundant rows, 

r-l 

/ r \ 

(68) 



R(H cpm . ds ) > (m w - 1) + (^j mi 11 ! . TO «> - Ml}- 



From the above redundancy analysis, it is straightforward to construct H cp m,ds with redundancies. The base matrix 
W should be low rank (the base matrices of random partition LDPC codes, Latin square LDPC codes and EG 
LDPC codes with rank 2 satisfy this requirement). Moreover, from (52), W should not have zero entries. 

Example 6. Based on the Latin Square over GF(2 5 ), we construct a base matrix 6 x 24 W with rank 2, which 
does not contain zero entries. Then, we form a new base matrix B^ from (50). From 31-fold matrix dispersion of 
fids, we obtain a 372 x 1488 parity-check matrix H cpm ^ s - Its rank is 327, i.e., there are 45 redundant rows which 
is exactly lower bounded by 45 (54). The null space ofH cpm ,d s defines a (6,24) QC-LDPC codes with code rate 
0.78. In Figure 4, compared with the PEG code with the same code length, column weight and code rate, it has 0.3 
dB coding gain at BER 10 -6 . Moreover, it is quasi-cyclic which is very cost efficient and is capable of correcting 
single burst erasures of length less than 5 x 31 + 1 = 156. 
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Fig. 4. The error performances of the (1488, 1161) QC-LDPC code given in Example 6. 



B. QC-LDPC Codes by Product-like Dispersion 

Let {W„ < i < 1} be a set of m w x n w base matrices over GF(q). Suppose that the rank of W,; is r W i. We 



form a new base matrix B„; from them such that 



B, 



W •■• 
Wi 

•■■ W; 



(69) 



B p ; has dimensions m = m 
the rank of B°* is upper bounded by min{TO g , ;H* } + J] mm{m w , p^ ^} . The parity-check matrix H c 



where C g is an m g x n w l matrix with rank [i g such that B p ; satisfies the 2x2 SM-constraint. The new base matrix 

m w l and n = n w l. Its rank is upper bounded by fi g + Vwi- Similar as (49), 

^ 1 ' 1 'Via nni^tn n\\Otn\r motriv T— T , fTlf 1 

cpra.pL 13 

e-fold dispersion of the base matrix B p /, where e is a factor of q — 1. Then from Corollary 3, should not have 
zero entries to maximize the redundancies in H cp „ l p /. Then, the rank of the parity-check matrix H cpm p ; is upper 
bounded by me — ci(m — ^ r w ^ + r g ). 



Example 7. Based on the Latin Square over GF(2 i ), we form two matrices 3x8 Wq and Wi. From 



we 



have the new base matrix from Wo, Wi and 2 x 16 (2,8) matrix C g . From 15-fold matrix dispersion o/B p ;, we 
obtain a 120 x 240 parity-check matrix H cpm p/. The null space o/H cpm p ; defines a (4,8) QC-LDPC codes with 
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Fig. 5. The error performances of the (240, 131) QC-LDPC code given in Example 7. 

code rate 0.56. In Figure 5, compared with the PEG code with the same code length, column weight and code 
rate, it has 0.2 dB coding gain at BER 10~ 6 . Moreover, we also constructed a (4,8) PEG code with 120 x 240 
parity-check matrix which is almost full rank for comparison. The proposed code has 0.2 dB coding gain at BER 
10~ 6 . 

Example 8. Based on the Latin Square over GF(2 e ), we form three matrices 4x18 Wo, Wi and W2. From 
H69h we have the new base matrix from W , Wi and 3 x 54 (1,18) matrix C g . From 63-fold matrix dispersion of 
B p ;, we obtain a 945 x 3402 parity-check matrix H cpm ,pi- The null space ofH cpmiP i defines a (5,18) (3402,2502) 
QC-LDPC codes with code rate 0.74. In Figure 6, compared with the PEG code with the same code length, column 
weight and code rate, it has 0.2 dB coding gain at BER 10 -6 . 

C. Irregular QC-LDPC Codes by Masking 

It is well known that the parity-check matrices of irregular QC-LDPC codes have few redundant rows. In this 
sub-section, we design irregular QC-LDPC codes with redundancies for the first time. Let W be an m x n base 
matrix over GF(g) with rank /j, w , where q = 2 r . M is the masking matrix with rank r rn . Then, a new base matrix 
Bi r is formed by the Hadamard product of W and M 

B ir = W o M. 
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Fig. 6. The error performances of the (3402, 2502) QC-LDPC code given in Example 8. 



The parity-check matrix H cpm ,ir is the e-fold dispersion of the base matrix Bj r , where e = 2 r — 1. The rank of 
Hcpm.ir is related to B,>, whose rank is bounded by Theorem 3, rank(Bi r ) < rank(Bi r ) x ranfc(M). Since 
there exist base matrices constructed from random partition, Latin squares and Euclidean geometries whose ranks 
are only 2. The left issue is to find M with low rank, so rank(Bi r ) < 2r m . If M also has good column degree 
distributions, then we can expect that H cpm ^ r performs well by message-passing algorithms in the threshold region. 
Moreover, since ranfc(H) < me — ci(m — 2r m ), extra coding gain from redundancies can be obtained. 

Such M can be constructed from the circulant matrix ^(h) formed by the parity-check vector h of high-rate 
cyclic codes (n,kh). M can be the sub-matrix or the full-matrix of the product 



C • $(h). 



(70) 



where the m x n matrix C is used to control the degree-distributions and the dimension of M. Thus, the rank of 
M is at most min{n — kf t , to}. For example, 

r 1 1 ••• 
1 1 •■■ 

1 ••• 1 

Example 9. Based on the Latin Square over GF(2 6 ), we form a 9 x 52 base matrix W; r . Since the null space of 



the minimum polynomial of x 



1 defines a (63,60) high-rate code, we use its parity-check vector to form a 



circulant ^(h) with rank 3. The M is a 9 x 52 sub-array of the product o/$(h) and C such that it has 26 columns 
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Fig. 7. The error performances of the (3276, 2733) QC-LDPC code given in Example 9. 



with weight 4 and 26 columns with weight 5. The new base matrix B ir /s formed by the Hadamard product of W 
and M. From 63-fold matrix dispersion of Bj r , we obtain a 567 x 3276 parity-check matrix H C pm,ir which have 
24 redundant rows. The null space ofH cpm .i r defines a (3276,2733) QC-LDPC codes with code rate 0.834. It only 
performs 1.4 dB away from the Shannon limit at BER 1CP 6 in Figure 7. 



IX. Conclusion and Remarks 

Thanks to the rank analyses fl8l . [26] based on the Fourier transform, we could expand the rank analysis and 
row-redundancy into all QC-LDPC codes. It is possible to take row-redundancy into account in code constructions 
such that structured QC-LDPC codes can achieve better performance. Furthermore, we presented a class of 2 x 2 
SM-constrained base matrices which are constructed based on partitions of finite fields of characteristic of 2. QC- 
LDPC codes defined by the null space of these base matrices are flexible for code design. For these codes, the 
equalities of the above bounds hold. 
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